Estimation of Rigid and Non-Rigid Facial Motion Using Anatomical Face Model
نویسندگان
چکیده
We present a model-based approach to recover the rigid and non-rigid facial motion parameters in video sequences. Our face model is based on anatomically motivated muscle actuator controls to model the articulated non-rigid motion of a human face. The model is capable of generating a variety of facial expressions by using a small number of muscle actuator controls. We estimate rigid and non-rigid parameters in two steps. First, we use a multi-resolution scheme to recover the global 3D rotation and translation by linear least square minimization. Then, we estimate the muscle actuator controls using the Levenberg-Marquardt minimization technique applied to a function, which is constrained by both optical flow and the dynamics of the deformable model. We present the results of our system on both real and synthetic images.
منابع مشابه
Estimation of Rigid and Non-Rigid Facial Motion Using Anatomical Face Model
We present a model-based approach to recover the rigid and non-rigid facial motion parameters in video sequences. Our face model is based on anatomically motivated muscle actuator controls to model the articulated non-rigid motion of a human face. The model is capable of generating a variety of facial expressions by using a small number of muscle actuator controls. We estimate rigid and non-rig...
متن کاملNon-rigid, but not rigid, motion interferes with the processing of structural face information in developmental prosopagnosia.
There is growing evidence to suggest that facial motion is an important cue for face recognition. However, it is poorly understood whether motion is integrated with facial form information or whether it provides an independent cue to identity. To provide further insight into this issue, we compared the effect of motion on face perception in two developmental prosopagnosics and age-matched contr...
متن کاملAutomatic scalable face model design for 2D model-based video coding
Scalable low bit-rate video coding is vital for the transmission of video signals over wireless channels. A scalable model-based video coding scheme is proposed in this paper to achieve this. This paper mainly addresses automatic scalable face model design. Firstly, a robust and adaptive face segmentation method is proposed, which is based on piecewise skin-colour distributions. 43 million skin...
متن کاملSubtly Different Facial Expression Recognition and Expression Intensity Estimation
We have developed a computer vision system, including both facial feature extraction and recognition, that automatically discriminates among subtly different facial expressions. Expression classification is based on Facial Action Coding System (FACS) action units (AUs), and discrimination is performed using Hidden Markov Models (HMMs). Three methods are developed to extract facial expression in...
متن کاملDifferential Processing of Facial Motion
To investigate viewpoint dependence in dynamic faces an avatar was animated using actors’ movements. In Experiment 1 subjects were shown a fullface animation. They were then asked to judge which of two rotated moving avatars matched the first. Test view, orientation and the type of motion were manipulated. In a second experiment subjects were shown two views of the same facial animation and wer...
متن کامل